• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    The invention relates to an image pickup device that can prevent leakage of excitation light into RGB and correct focus deviation between visible light and IR light and correct intensity of visible light and IR light even without a complicated structure. The imaging device (10) comprises an irradiation unit (12) which irradiates an object to be photographed containing a fluorescent substance with excitation light and illumination light, a 4-color dividing device (16) which divides light incident into the lens (14) into R/G /B/IR, an image sensor (18) which subjects the split light to opto-electrical conversion, an image signal output unit (20) which generates an image signal from an electrical signal based on the opto-electrical conversion, an image display device (22) which displays an image from the image signal, a bandpass filter (24) which does not transmit light in the wavelength range of the excitation light, and a correction filter (26), the correction filter (26) having a circular visible light blocking region (30) which blocks visible light in the incident light , and a circular IR blocking area (28) that blocks IR light in the incident light, and also a dummy Glass (32) of specified thickness is provided.
    公开号:CH715451B1
    申请号:CH00255/20
    申请日:2018-07-11
    公开日:2022-01-31
    发明作者:Saito Takaaki
    申请人:Ikegami Tsushinki Kk；
    IPC主号:
    专利说明:

    technical field
    The present invention relates to an image pickup device that shoots a shot subject containing a fluorescent substance and displays the shot, and particularly relates to an image pickup device that corrects focus deviation of incident visible light (R/G/B) and IR light and can also correct its intensity.
    General state of the art
    An image pickup device using a 4-color splitting prism and an image pickup system based on an endoscope are known in the prior art. These use splitting prisms that can split light entering through a lens into R/G/B components and an IR component.
    For example, in Patent Document 1, an endoscope is disclosed including a 4-color splitting prism having a blue splitting prism, a red splitting prism, and a green splitting prism that split light from a treatment section into a blue component, a red component, and a green component , and an IR splitting prism that splits an IR component from the light of the treatment section, a blue image sensor that is installed in the blue splitting prism and converts the split blue component into an electric signal, a red image sensor that is in the red splitting prism is installed and converts the split red component into an electrical signal, a green image sensor installed in the green splitting prism and converts the split green component into an electrical signal, an IR image sensor installed in the IR splitting prism and the split converts IR component into an electrical signal, and a signal output section which is a RGB signal and an IR signal of the converted electric signals, wherein the IR split prism is arranged closer than the blue split prism, the red split prism and the green split prism on the receiving object side with respect to the incident light from the treatment section, and emits light with the blue component, the red component and the green component passes.
    Patent Document 2 discloses an image pickup device comprising a color splitting prism having a dichroic layer that separates light falling in the visible light wavelength range and light falling in the fluorescence wavelength range, an image pickup element for fluorescence imaging, which is arranged downstream of the color splitting prism and images light in the fluorescence wavelength range which has been split by the dichroic layer, an image pickup element for imaging visible light which is arranged downstream of the color splitting prism and images light in the visible light wavelength range which has been split by the dichroic layer, and a band-pass filter disposed between the color splitting prism and the fluorescent imaging image pickup element and having a light incident plane vertical to the optical axis, the fluorescent imaging image pickup element and the imaging image pickup element formation of visible light are arranged such that an optical path difference between an optical path length of an optical path of fluorescence, which passes through the color splitting prism and is imaged by the image pickup element for fluorescence imaging, and an optical path length of an optical path of the visible light, which passes through the Color splitting prism occurs and is imaged by the visible light imaging image pickup element, corresponds to an amount of deviation between a fluorescence imaging position and a visible light imaging position generated by an imaging lens arranged in front of the color splitting prism.
    In this image pickup device, the image pickup element for fluorescence imaging and the image pickup element for visible light imaging are each fixed according to the deviation of the optical path length, and use a structure with which their distance is changeable, and adjust a focus deviation between RGB of the visible wavelength region Light and IR of the fluorescence wavelength range.
    Prior Art Documents
    patent documents
    Patent Document 1: Japanese Patent Laid-Open Publication No. 6025130 Patent Document 2: Japanese Unexamined Patent Application No. 2017-53890
    Summary of the Invention
    Object of the present invention
    However, in the technique disclosed in Patent Document 1, although indocyanine green (hereinafter ICG) which is a fluorescent substance is intended to be used, no discussion of the beam splitting curve is made. The wavelength of excitation light such as ICG is 750nm to 810nm, but since a curve in a figure of the technique of the present disclosure shows sensitivity even below 800nm, there is a fear of leakage of RGB component to deteriorate the composite image, etc .
    Furthermore, since the focus point of RGB and IR is usually different, there is a focus deviation, and in the case of the technique disclosed in Patent Document 1, in each sensor connection, the focus position must be changed for connection with the lens system used, resulting in a complicated structure. The increase in IR sensitivity that is significant in such a technique is accomplished solely by adding to surrounding pixels, so it may be difficult to achieve the desired sensitivity.
    As described above, in the technique disclosed in Patent Document 2, the image pickup element for fluorescence imaging and the image pickup element for visible light imaging according to the focus deviation of RGB and IR are respectively fixed according to the deviation of the optical path length or have a structure with which their distance is changeable, so the structure is finally complicated.
    It is an object of the present invention, to solve the above problems, to provide an image pickup device which can prevent leakage of excitation light such as ICG in RGB, correct focus deviation between visible light and IR light, and also correct intensity of visible light and of the IR light can be corrected.
    means of solving the task
    According to the present invention, there is provided an image pickup apparatus comprising an irradiation unit that irradiates a pickup object containing a fluorescent substance with excitation light for exciting the fluorescent substance and light for illuminating the pickup object, a 4-color splitter that irradiates incident light from the recording object incident on a mounted lens into an R component/G component/B component and an IR component, respectively, an image sensor that receives the incident light divided by the 4-color dividing means, and one each undergoes opto-electrical conversion, an image signal output unit that generates and outputs an image signal from the electric signal obtained by the opto-electrical conversion by means of the image sensor, an image display device that displays an image based on the image signal output by the image signal output unit, a band-pass filter, because s is arranged between the lens and the 4-color separator and transmits light in the wavelength range of the excitation light, and a correction filter arranged between the band-pass filter and the lens. The correction filter has a circular visible light blocking area that blocks visible light in the incident light and a circular IR blocking area at the center position of the visible light blocking area that blocks IR light in the incident light, with a surface of the IR blocking area facing the bandpass filter, a dummy glass of fixed thickness is provided which has the same circular shape as the IR blocking area.
    According to the present invention, by arranging the correction filter at the aperture position of the optical system (lens, microscope adapter) in which the image pickup device is mounted, the depth of field can be increased by means of the aperture effect on the visible light side, and by the IR blocking on the visible light side and the thickness gauge of the dummy glass, the focus deviation between the visible light and the IR light can be corrected. Also, due to the aperture effect on the visible light side, the intensity of the visible light is reduced, whereby the intensity of the visible light and the IR light entering the optical system can be corrected to an appropriate level.
    The correction filter is preferably provided with a dummy glass, the thickness of which corresponds to the wavelength of the IR light.
    Brief description of the figures
    1(a) is a side view and FIG. 1(b) is a front view showing the structure of a correction filter in an embodiment of an image pickup device according to the present invention; Fig. 2 is a schematic structural view of the image pickup device of the embodiment of the present invention; Fig. 3 is a graph showing a beam splitting curve of a 4-color splitting prism; Fig. 4 is a graph of a curve of an optical bandpass filter; and FIG. 5 is a graph showing a beam splitting curve (combined beam splitting curve) in a state of combining the 4-color splitting prism and the optical band-pass filter.
    Embodiments of the invention
    An embodiment of an image pickup device of the present invention will be described with reference to the figures. 1(a) and 1(b) show a side view and a front view, respectively, of the structure of a correction filter in the embodiment of the image pickup device according to the present invention, and FIG. 2 shows a schematic structural view of the image pickup device of the embodiment of the present invention Invention.
    Reference numeral 10 denotes an image pickup device, reference numeral 12 an irradiation unit, reference numeral 14 a lens, reference numeral 16 a 4-color splitter, reference numeral 18 an image sensor, reference numeral 20 an image signal output unit, reference numeral 22 an image display device, reference numeral 24 a band-pass filter, reference numeral 26 a correction filter, reference numeral 28 an IR blocking portion, reference numeral 30 a visible light blocking portion, and reference numeral 32 a dummy glass.
    As shown in Fig. 2, the image pickup device 10 of the present embodiment includes the irradiation unit 12 that irradiates a shooting object containing a fluorescent substance with excitation light for exciting the fluorescent substance and light for illuminating the shooting object, and the 4 colors - Splitting means 16 which splits incident light from the subject, incident on a mounted lens 14, into an R component/G component/B component and an IR component, respectively.
    It also includes the image sensor 18, which receives the incident light divided by the 4-color splitter 16 and subjects it to opto-electrical conversion, the image signal output unit 20 which, from the electrical signal produced by the opto-electrical conversion by the image sensor 18 is obtained, generates and outputs an image signal, the image display device 22 which displays an image based on the image signal output from the image signal output unit 20, the band-pass filter 24 which is arranged between the lens 14 and the 4-color splitter 16 and no light in in the vicinity of or in the wavelength region of the excitation light, and the correction filter 26 which is arranged between the band-pass filter 24 and the lens 14.
    In the embodiment, the correction filter 26 has the circular visible light blocking area 30 that blocks visible light in the incident light and the circular IR blocking area 28 in the center position of the visible light blocking area 30 that blocks IR light in the incident light blocks light, and on a surface of the IR blocking portion 28 facing the band pass filter 24, the dummy glass 32 of fixed thickness having the same circular shape as the IR blocking portion 28 is provided.
    Next, the embodiment of the image pickup device of the present invention will be described in detail. In a surgical procedure using an image pickup device with an endoscope and the like, a technique is used in which a fluorescent substance such as ICG (indocyanine green) is injected into the body, a treatment portion where ICG accumulates is irradiated with near infrared rays , and an image is taken of a site containing the treatment section.
    When an image of the treatment portion is obtained by capturing light containing IR light by an image pickup device in which the image sensor is a single plate, the light incident surface of the image sensor must be divided into four to form R/G/B and IR to provide filters, which increases the size of the image sensor and makes it difficult to use for an image pickup device with an endoscope and the like.
    In the present embodiment, since the 4-color dividing device 16, which divides incident light from the subject to be photographed and incident on the mounted lens 14, into an R component/G component/B component and an IR component, respectively, For example, the size of the image sensor can be restricted and a compact structure as a whole can be achieved, so that it can be applied to an image pickup device with an endoscope and the like.
    When white light is irradiated and photographed by a microscope image pickup device, although a fluorescence photograph is included in the photograph, since the background light is white light (which contains excitation light), the contrast of the fluorescence photograph does not stand out at all. By using excitation light exclusively as illumination light and by providing an optimal edge filter on the excitation light side and the color filter side of the image, the contrast of the fluorescence image is excellent compared to white light when the image is of the same type.
    In order to obtain high-quality, high-contrast fluorescence recording, the background light of the excitation light must be blocked. Therefore, in the present embodiment, between the lens 14 and the 4-color splitting device 16, a plurality of bandpass filters 24 are arranged with a transmission that does not let through any light in the vicinity of the wavelength range of the excitation light.
    Thus, by using a band-pass filter which has an extremely low transmittance for the wavelength range of the excitation light like the band-pass filter curve shown in Fig. 4, the background light of the excitation light can be blocked. By this band-pass filter 24, the beam splitting curve of the 4-color splitting prism shown in FIG. 3 can obtain the beam splitting curve (4-color splitting prism + band-pass filter) shown in FIG. The bandpass filter 24 is interchangeable, allowing multiple fluorescence views just by changing the filter.
    In a fluorescence microscope, the structure is such that a module constituting a set of excitation light and color filter is employed depending on the fluorescent color used, in the case where the imaging device is a camera or the like and it is difficult to replace a four-plate prism Depending on the fluorescence color and fluorescence probe used, a common edge steepness is used for the excitation light and the recording color filter, which makes it easier to change the curve on the optical filter.
    In the present embodiment, the correction filter 26 is arranged between the bandpass filter 24 and the lens 14 . As shown in Fig. 1(b), the correction filter 26 has the visible light blocking area 30 that blocks the visible light in the incident light, and the circular IR blocking area 28 that is located at the center position of the visible light blocking area 30 and blocks IR light in the incident light.
    When visible light emitted by the irradiation unit 12 is incident from the recording object through the lens 14 of the imaging device 10, there is an iris effect on the visible light side due to the aperture of the IR blocking region 28, so that the depth of field can be increased by this configuration can.
    As shown in Fig. 1(a), on a surface of the IR blocking portion 28 facing the band pass filter 24, the dummy glass 32 of fixed thickness having the same circular shape as the IR blocking portion 28 is provided . The focus position of the visible light is shifted by the dummy glass 32, whereby the focus position of the visible light and the IR light are adjusted to each other.
    Because of this structure, the focal position of the visible light and the IR light can be corrected even without complicated facilities and structures. A dummy glass 32 with a thickness that corresponds to the IR light (its wavelength) can be specifically selected on the correction filter 26 . In this way, IR light from each fluorescent substance can be corrected for focus deviation from visible light.
    Commercial Application
    The image pickup device of the present invention can prevent leakage of excitation light such as ICG in RGB, correct focus deviation between visible light and IR light, and also correct intensity of visible light and IR light without a complicated structure.
    Explanation of the reference symbols
    10 Image pickup device 12 Irradiation unit 14 Lens 16 4-color splitter 18 Image sensor 20 Image signal output unit 22 Image display device 24 Band-pass filter 26 Correction filter 28 IR blocking area 30 Visible light blocking area 32 Dummy glass
    权利要求:
    Claims (2)
    [1]
    An imaging device (10) comprising:an irradiation unit (12) which irradiates a subject containing a fluorescent substance with excitation light for exciting the fluorescent substance and with light for irradiating the subject,a 4-color splitting device (16) which splits incident light from the subject, which is incident on a mounted lens (14), into an R component/G component/B component and an IR component, respectively,an image sensor (18) receiving the incident light divided by the 4-color dividing means (16) and subjecting each to an optoelectric conversion,an image signal output unit (20) which generates and outputs an image signal from the electric signal obtained by the optoelectric conversion by means of the image sensor (18),an image display device (22) which displays an image based on the image signal output from the image signal output unit,a band-pass filter (24) which is arranged between the lens (14) and the 4-color splitter (16) and does not transmit light in the wavelength range of the excitation light, anda correction filter (26) arranged between the bandpass filter (24) and the lens (14),characterized in that the correction filter (26) has a circular visible light blocking area (30) which blocks visible light in the incident light and a circular IR blocking area (28) in the center position of the visible light blocking area (30) which Blocking IR light in the incident light, a dummy glass (32) of fixed thickness is provided on a surface of the IR blocking portion (28) facing the band pass filter (24) having the same circular shape as the IR Blocking area (28).
    [2]
    2. Image pickup device (10) according to claim 1, characterized in that the correction filter (26) is provided with a dummy glass (32) whose thickness corresponds to the wavelength of the IR light in order to correct the focus deviation from the visible light.
    类似技术:
    公开号 | 公开日 | 专利标题
    DE102011000835B4|2014-04-03|Scanning microscope and method for light microscopic imaging of an object
    DE102008062650B9|2021-10-28|Surgical microscope for observing infrared fluorescence and methods for this
    EP2551713B1|2016-09-14|Microscope lighting process and microscope
    DE102011016138A1|2012-10-04|Device for fluorescence diagnosis
    DE102014008243A1|2015-12-03|Fluorescence observation system and optical filter system therefor
    DE102007019335C5|2010-08-26|microscope
    DE102010045364A1|2012-03-15|Method for generating high-quality fundus image of eye of patient, involves obtaining color intensity distribution for correcting color composition of resultant color fundus image based on dark image representing noise of sensor
    DE112015003666T5|2017-05-18|Image pickup element and endoscope device
    DE102011013614A1|2012-09-13|Laser scanning microscope and method of its operation
    DE102014016850B4|2017-02-09|Optical system for fluorescence observation
    DE102015216570A1|2016-11-03|microscopy system
    DE102013009817B4|2019-10-31|Microscopy system for observation of fluorescence in ophthalmology
    DE102015203844A1|2016-09-08|Optic system and surgical microscope
    DE102006057190A1|2008-06-12|Method of producing high quality images of the anterior and / or posterior segments of the eye
    DE102016106518A1|2017-10-12|Optic system for an endoscope
    DE102018114695B9|2020-05-28|Filter set, system and method for the simultaneous excitation and observation of protoporphyrin IX and fluorescein
    DE102017210274A1|2018-12-20|Microscopy system and microscopy method for recording fluorescent light images and white light images
    DE102009010446B4|2015-07-09|Method and apparatus for quantifying blood flow in a tissue area
    CH715451B1|2022-01-31|image pickup device.
    DE102016104439A1|2017-03-02|An imaging device, an optical observation device, and a method of capturing images
    DE112017002066T5|2019-01-03|Projection display unit
    DE102013208872A1|2014-11-20|Method for generating an image of a sample
    DE102005045907B4|2014-05-22|Device for displaying a tissue containing a fluorescent dye
    DE102011053250A1|2013-03-07|Method for recording images of e.g. brain of patient during surgical intervention by operation microscope, involves performing exposing of sensor and reading of partial surface before once again exposing sensor and reading sensor surface
    DE102015005514A1|2016-11-03|Device for protecting the eyes from harmful light or radiation sources
    同族专利:
    公开号 | 公开日
    JP6580646B2|2019-09-25|
    DE112018004829T5|2020-06-10|
    US20200195819A1|2020-06-18|
    JP2019042195A|2019-03-22|
    WO2019044193A1|2019-03-07|
    US11006026B2|2021-05-11|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    JPS6025130B2|1982-03-24|1985-06-17|Tokyo Aruminiumu Kogyo Kk|
    JP3285265B2|1993-12-03|2002-05-27|オリンパス光学工業株式会社|Fluorescence observation device|
    US5749830A|1993-12-03|1998-05-12|Olympus Optical Co., Ltd.|Fluorescent endoscope apparatus|
    JP2000171687A|1998-09-28|2000-06-23|Asahi Optical Co Ltd|Range-finder|
    JP4937991B2|2004-12-08|2012-05-23|オリンパス株式会社|Fluorescence endoscope apparatus and imaging unit used therefor|
    JP5028008B2|2004-12-08|2012-09-19|オリンパス株式会社|Fluorescence endoscope device|
    JP2016087062A|2014-11-04|2016-05-23|ローム株式会社|Optical biological imaging system|
    JP6025130B2|2015-03-23|2016-11-16|パナソニックＩｐマネジメント株式会社|Endoscope and endoscope system|
    JP6589471B2|2015-09-07|2019-10-16|ソニー株式会社|Imaging apparatus, microscope imaging system, and endoscope imaging system|
    US20170111557A1|2015-10-20|2017-04-20|Google Inc.|Camera assembly with filter providing different effective entrance pupil sizes based on light type|
    US10122975B2|2016-05-19|2018-11-06|Panasonic Intellectual Property Management Co., Ltd.|Endoscope and endoscope system|
    EP3610779A4|2017-05-17|2020-05-13|Sony Corporation|Image acquisition system, control device, and image acquisition method|
    US10725292B2|2018-02-01|2020-07-28|Varjo Technologies Oy|Gaze-tracking system and aperture device|
    法律状态:
    2020-10-15| PCAR| Change of the address of the representative|Free format text: NEW ADDRESS: ROTENBODENSTRASSE 12, 9497 TRIESENBERG (LI) |
    2021-12-30| PL| Patent ceased|
    优先权:
    申请号 | 申请日 | 专利标题
    JP2017169153A|JP6580646B2|2017-09-04|2017-09-04|Imaging device|
    PCT/JP2018/026176|WO2019044193A1|2017-09-04|2018-07-11|Image capture device|
    [返回顶部]